Kernel‐risk‐sensitive conjugate gradient algorithm with Student's‐t distribution based random fourier features
نویسندگان
چکیده
Kernel-risk-sensitive loss (KRSL) achieves an efficient performance surface, which has been applied in the kernel adaptive filters (KAFs) successfully. However, KRSL based KAFs use stochastic gradient descent (SGD) method optimization, usually suffer from inadequate accuracy with slow convergence speed. In this letter, conjugate is adopted optimization of function, and problem non-convexity addressed by twice half-quadratic (HQ) methods. For sparsification, a novel Student's-t distribution random Fourier feature (St-RFF) for improvement conventional RFF method. Thus, features kernel-risk-sensitive (St-RFFKRSCG) algorithm proposed. Simulations on Mackey-Glass time series prediction under non-Gaussian noises confirm superiorities terms performance, robustness, computational cost.
منابع مشابه
Fourier domain preconditioned conjugate gradient algorithm for atmospheric tomography.
By 'atmospheric tomography' we mean the estimation of a layered atmospheric turbulence profile from measurements of the pupil-plane phase (or phase gradients) corresponding to several different guide star directions. We introduce what we believe to be a new Fourier domain preconditioned conjugate gradient (FD-PCG) algorithm for atmospheric tomography, and we compare its performance against an e...
متن کاملAn Efficient Conjugate Gradient Algorithm for Unconstrained Optimization Problems
In this paper, an efficient conjugate gradient method for unconstrained optimization is introduced. Parameters of the method are obtained by solving an optimization problem, and using a variant of the modified secant condition. The new conjugate gradient parameter benefits from function information as well as gradient information in each iteration. The proposed method has global convergence und...
متن کاملConjugate Gradient Algorithm with Data Selective Updating
This paper applies data selective updating to the Modified Conjugate Gradient algorithm. In search for a new conjugategradient-like filtering algorithm, two different approaches are developed: the first one results in the recently proposed set-membership affine projection (SM-AP) algorithm and the second one reduces the computational requirements of the modified congujate gradient algorithm whi...
متن کاملStochastic Conjugate Gradient Algorithm with Variance Reduction
Conjugate gradient methods are a class of important methods for solving linear equations and nonlinear optimization. In our work, we propose a new stochastic conjugate gradient algorithm with variance reduction (CGVR) and prove its linear convergence with the Fletcher and Revves method for strongly convex and smooth functions. We experimentally demonstrate that the CGVR algorithm converges fast...
متن کاملA new hybrid conjugate gradient algorithm for unconstrained optimization
In this paper, a new hybrid conjugate gradient algorithm is proposed for solving unconstrained optimization problems. This new method can generate sufficient descent directions unrelated to any line search. Moreover, the global convergence of the proposed method is proved under the Wolfe line search. Numerical experiments are also presented to show the efficiency of the proposed algorithm, espe...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Electronics Letters
سال: 2023
ISSN: ['0013-5194', '1350-911X']
DOI: https://doi.org/10.1049/ell2.12809